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We study the s-wave quintet Cooper pairing phase (S pa i r = 2) in spin-3/2 cold atomic 
systems and identify various novel features which do not appear in spin-1/2 pairing 
systems. A single quantum vortex is shown to be energetically less stable than a pair 
of half-quantum vortices. The half-quantum vortex exhibits the global analogue of the 
non-Abelian Alice string and SO(4) Cheshire charge in gauge theories. The non-Abelian 
half-quantum vortex loop enables topological generation of quantum entanglement. 
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1. Introduction 

Optical traps and lattices open up a whole new direction in the study of strongly 
correlated large spin systems by using cold atoms with hyperfine multiplets. In 
spin-1 bosonic systems (e.g. 23 Na and 87 Rb), spinor condens ations, spin textures 
and nematic orders have generated a great deal of attention l l | 2 | 3 ' 4 | 5 |617| Q n 
other hand, large spin fermions also exhibit many exciting novel features. For in- 
stance, the multi-particle clustering instability, i.e., a multi-particle counterpart of 
Cooper paring, is not allowed in spin 1/2 system s due to Pauli's exclusion princi- 
ple, but is possible in large spin systems l ^ l ^ l -M I, Furthermore, large spin fermions 
offer a unique playground to study high symmetries which do not appear in usual 
condensed matter systems. We have proved that spin-3/2 fermionic systems with 
contact interactions, which can be realized by atoms such as 132 Cs, 9 Be, 135 Ba, 
137 Ba and 201 Hg, enjoy a generic 5*0(5) symmetry for the continuum model with 
s-wave scattering interactions and the lattice Hubbard model, whose exactness is 
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regardless of dimensionality, lattice geometry and external potentials Such a 
high symmetry without fine-tuning is rare in both condensed matter and cold atom 
many-body systems. The important consequences of this symmetry are systemati- 
cally investigated, including the protected degeneracy in collective excitations, the 
absence of the quantum Monte-Carlo sign problem, the four-fermion quartetting su- 
perfluidity, and eve n stronger quantum magnetic fluctuations than spin - 1/2 systems 
| lz | i<j | 14 | ii3 | e | ib | l i \ which has been summarized in a review article 

On the other hand, impor tant progres s has been made in the fault-tolerant topo- 
logical quantum computation HM1 20 | 21 | 22 | ip^e j^y i s that by using non-Abelian 
statistics in two dimensions, particles can be entangled in a robust way against local 
disturbances. The promising candidate systems to implement topological quantum 
computation in clud e the non-Abelian qu ant um Hall states with fermions at the 
filling v = 5/2 and bo sons at v = 1 and also the p x + ip y pairing state 
of spinless fermions | 25 | 26 | j n p aper, we show that due to the 50(5) symme- 
try in spin-3/2 cold atomic systems LUJSI the s-wave quintet Cooper pairing state 
(Spair = 2) in such systems provides another opportunity to topologically gener- 
ate quantum entanglement between the particle and the non-Abelian half-quantum 
vortex (half-quantum vortex) loop. 

The half-quantum vortex in superfluids with the spin degree of freedom is an 
exotic topo logical defect as a global analogue of the Alice string in gauge theories 
| 27 | 28 | 29 |30| -j,^ half-quantum vortex loop can possess spin quantum number which 
is an example of the Cheshire charge phenomenon. An Abelian version of the global 
Alice string an d Cheshire charge exists in the triplet superfluid of the 3 He-A phase 



Alice string an< 
31 32 33 34 35 



where the spin 5(7(2) symmetry is broken into the (7(1) symmetry 
around the z-axis. A remarkable property is that both quasi-particles and spin wave 
excitations reverse the sign of their spin quantum numbers s z when going through 
the half-quantum vortex loop. Meanwhile the half-quantum vortex loop also changes 
s z to maintain spin conservation. However, due to the Abelian nature of this (7(1) 
Cheshire charge, no entanglement is generated in this process. 

In this article, we investigate the non-Abelian Alice string and the topological 
generation of quantum entanglement through the non-Abelian Cheshire charge in 
spin-3/2 systems. The quintet Cooper pairing order parameters in the polar basis 
form a 5-vector of the 50(5) symmetry group. The ground state exhibits the polar 
condensation where the 50(5) symmetry is broken into 50(4) This allows the 
half-quantum vortex loop to possess the non-Abelian 50(4) Cheshire charge, in 
contrast to the (7(1) Cheshire charge in the 3 He-A phase. We also explore the 
high symmetry effects on collective spin excitations and the structure of the half- 
quantum vortex line as a 7r-disclination in the spin channel. We show that by driving 
the fermion quasiparticle (or spin-wave impulse) through the half-quantum vortex 
loop, quantum entanglement between them is topologically generated. This effect 
has a potential application in the topological quantum computation. 
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2. Quintet Pairing 

The spin- 1 system is the simplest one to support the s-wave quintet pairing with 
total spin St = 2. In such a system with contact interactions, a hidden SO(5) 
symmetry arises as follows: the four-component spinor 

V> = (C3 , Ci , C_i, c_i) T (1) 

r v 2 2 2 2 ' x/ 

forms the spinor representations of the Si/ (4) group which is the unitary transfor- 
mation of the four-component spinor. Each of the four component contributes the 
same to the kinetic energy which is explicitly SU (4) symmetric. Generally speak- 
ing, the interactions break this symmetry to a lower level. From the view of the 
spin SU(2) group, the interactions can be classified into the total spin O(singlet), 
1 (triplet), 2 (quintet), 3 (septet) channels. For the contact interactions, say, s-wave 
scattering, only total spin singlet and quintet channel are allowed as required by the 
Pauli's exclusion principle. Interestingly, the spin SU (2) singlet channel can also be 
interpreted as an SO (5) singlet, and the spin SU{2) quintet channel can be inter- 
preted as an SO (5) vector channel. This SO (5) group only lies in the particle-hole 
channel as a subgroup of the SU (4) group. Thus, the remaining symmetry with the 
s-wave scattering interaction is SO (6) without fine-tuning of parameters. 

We denote the interaction strength in the spin singlet and triplet channels as 
go and 52, respectively. We consider the case of g% < where the quintet channel 
Cooper pairing dominates, and further neglect the interaction in the singlet channel. 
The mean field Hamiltonian reads 

Hmf = / d D r{ J2 ^( r )("W- " v)Mr) + £ xl(r)A a (r) + h.c. 

a=±|,±i »=1~6 

- -A:(r)A a (r)\, (2) 
92 > 

with D the spatial dimension, [i the chemical potential, and M the atom mass. A a is 
proportional to the ground state expectation value of the quintet pairing operators 
Xa by 

A a (r)=g 2 ( Xa (r)), (3) 

where a = 1 ~ 5. The five Xa operators are the spin channel counterparts of the five 
atomic d-orbitals (d xy ,d xz ,d yzi d 3z 2_ r 2 : d x 2_ y 2) : and transform as a 5-vector under 
the SO (5) group. Explicitly, they are expressed as 

xUr)=-^ a (r)(r a R) a ^l(r), (4) 
where the five 4x4 Dirac T a (a — 1 ~ 5) matrices are defined as 
-H\ r 2,3,4 = (* \ p5= fOI 



il J ' \0 ~a J ' \I 

which satisfy the anti-commutation relation as {r a ,r b } = 25 a b, and R — T 1 r 3 is 
the charge conjugation matrix El 
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Fig. 1. A) The Goldstone manifold of d is a 5D hemisphere RP 4 . It contains a class of non- 
contractible loops as marked by the solid curve. B) The 7r-disclination of d as a half-quantum 
vortex. Assume that d \\ t>4 at <f> = 0. As the azimuthal angle </> goes from to 2ir, d is rotated at 
the angle of <j>/2 around any axis h in the S 3 equator spanned by ei, 2,3,5- 



This 50(5) symmetry leads to new interesting results about the pairing structure 
in the ground state and the corresponding Goldstone modes. Within the BCS theory, 



Ref.^^ showed that the ground state of Eq.[2]is an 50(3) polar condensate without 
noticing the hidden 50(5) symmetry. We conclude here that the ground state is 
generically an 5*0(5) polar condensate. The order parameters can be parameterized 
as A a = \A\e l9 d a , where 9 is the U(l) phase, d — d a e a is a 5D unit vector, and 
e a (a — 1 ~ 5) form a set of basis for the internal spin space. Rigorously speaking, d 
is a directionless director instead of a true vector because A a 's contain a Zi gauge 
symmetry of 



-d, 6^9 + tt. 



(5) 



Thus the Golstone manifold is [50(5) <g> U(l)]/[SO(4) <g) Z 2 ] = RP 4 <E> U(l), where 
RP 4 is a 51? hemisphere instead of an entire 5 4 sphere as depicted in Fig. [T]A. 

The general Ginzburg-Landau free energy without the gradient term for quintet 
pairing has been given in Ref.l^Slwith three independent quartic terms. In the special 
spin- 1 case with the SO (5) symmetry, it can be simplified into a more convenient 
SO (5) invariant form with only two quartic terms 



where 



d 6 r 



| 7 VA:.VA Q + a(T)A* A a + ^-(A*A a ) 2 + A 



2- £ 

l<a<h<5 



Zb}, (6) 



Lab — 



A* a A b - A*A a 
V2 



(7) 



The first quartic term describe the density interaction among Cooper pairs while 
the second one describes the spin interaction among them. The polar-like state is 
favorable to make L a {, = at /?2 > 0, while the axial state is favorable at 02 < 0. 
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Around the critical tempe ratu re T c , the parameters a,/3i,2 was calculated from the 
Gor'kov expansion in Ref. ^^Sl 

1 dn , T . „ „ 1 dn 7<T(3) 
a =-2Te^-¥} ^=^=2Te^ (8) 

where n is the particle density, dn/de is the density of states at the Fermi level, and 
is the Riemann zeta function. The coefficient of 7 can also be calculated as 

_ nh 2 7C(3) 



AM 8ir 2 T? ' 



(9) 



3. Gross-Pitaevskii equation 



At zero temperature, the Ginzburg-Landau free energy fails. The low energy degree 
of freedom is described by an effective Gross-Pitaevskii equation for the Cooper 
pairs. In addition to the usual phonon mode, four branches of spin wave modes car- 
rying the spin quantum number S — 2 arise because of the spontaneous symmetry 
breaking from 5*0(5) to 50(4). In other words, they can be called "spin nematic 
waves" . For small fluctuations, the spin wave modes decouple from the phase mode. 
For the purpose of describing collective excitations, Cooper pairs can be treated as 
composite bosons. This treatment gi ves a go od approximation to the phonon mode 
in the neutral singlet BCS superfluid 

Here we generalize this method to the quintet pairing by using a phenomeno- 
logical Hamiltonian for spin-2 bosons 

fi2 

. 'I' ■ M' ■ : — III 1 1 " 

2Xp 



Heff= [d D r{^- ]T V*tV¥ + -^(*t¥ -/>„) 



Ka<5 



1 



E 



{^ c L^ d f}, (10) 



2Xsp l<a<6<5 

where ^a's are the boson operators in the polar basis, the equilibrium Cooper pair 
density po is half of the particle density pj,Xp an d Xsp & re proportional to the 
compressibility and SO(5) spin susceptibility respectively. We define the SO(5) 
generators in the 5x5 vector representation as 

L% = i(8 ac 5 bd -6 ad 8 bc ). (11) 

The Landau parameters in the 50(5) symmetric Fermi liquid theory for spin-| 
systems can be decomposed into three sectors as 50(5) scalar Ff (density), vector 
Fi (spin-quadrapole density), tensor Ff (spin and spin-octupo le dens ities) , where 
/ denotes the quantum number of orbital angular momentum Taking into 

account the Fermi liquid correction, 

* Nf X - — (12) 

Xp -4(1+F$y Xsp "4(l + ^*)' [ ' 

where Nf is the fermion density of states at the Fermi energy. 
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We introduce p{r) as the Cooper pair density and lab{r) as the SO(5) spin 
density, and parameterize ^> a = ^fp^e 1 ® d a . Using the standard commutation rules 
between l a b and d a , p and 9, we arrive at 

d t lab = ( da ^ 2db ~ db^ 2 d a ), Xspdtda = -Lbdb, 

X P d?6-^V 2 9 = 0, (13) 

where p sp is the superfluid density and p s is the spin superfluid density. At T = 
OK in a G alile an invariant system, p s is just pj /2, while p sp receives Fermi liquid 
corrections ^Sl as 

p sp _ 1 + f-f/3 



(14) 

where Ff is the Landau parameter in the 50(5) vector channel ^] xhe spin wave 



Ps 1 + Ff/3 
ter ii 

and sound velocities are obtained as 



•-v _ \ ~ ».f' u s - \ j — jj, (15) 



2 Xsp M' V 2 Xp m 

respectively. 



4. Half-quantum vortex 

The fundamental group of the GS manifold is 

7n(i?F 4 ® C/(l)) = Z®Z 2 . (16) 

The i?2 feature gives rise to the existence of the half-quantum vortex as a stable 
topological defect as depicted in Fig.[T]B. As we move along a loop enclosing the half- 
quantum vortex, the 7r phase mismatch in the 9 field is offset by a 7r-disclination in 
the c*-field, thus A a 's are maintained single- valued. Energetically, a single quantum 
vortex is less favorable than a pair of half-quantum vortices. From Eq.[lOl the static 
energy function can be written as 

E = J d D r^- i { Ps {V9f + p sp {Vdf}. (17) 

The energy density per unit length of a single quantum vortex is E\ = j^jPs log ^, 
while that of two isolated half-quantum vortices is E% — jrj(p s + Psp) log \- Al- 
though at the bare level p s = p sp , p sp receives considerable Fermi liquid correction 
and strong reduction due to quantum fluctuations in the 5D internal space. Gener- 
ally speaking, the relation, 

Psp < Ps, (18) 

holds in terms of their renormalized values. Then a single quantum vortex is frac- 
tionalized into a pair of half-quantum vortices. In the presence of rotation, the half- 
quantum vortex lattice should appear instead of the usual single quantum vortex 
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lattice. As a result of the doubling of vortex numbers, their vortex lattice constants 
differ by a factor of V2- 

The half-quantum vortex was also predicted in the 3 He-A phase, where d is a 
3D vector defined for spin-1 Cooper pairs. However, the dipole locking effect favors 
the d- vector aligned along the fixed direction of the "-vector, i.e., the direction of 
the p-wave orbital angular momentum. As a result, the two half-quantum vortices 
are linearly confined by a string of the mismatched d and "-vectors. In contrast, the 
orbital part of the quintet pairing is s-wave, no dipole locking effect exists. 




Fig. 2. The configuration of a 7r-disclination pair or loop described by Eq. 1241 4>1.2 and A<f> are 
azimuthal angles and d(f) |j &4 as r — ► oo. After a fermion passes the half-quantum vortex loop, 
the components with S z = ± | change to S z = ± ^ and vice versa with an SU(2) matrix defined 
in Eq. \TI\ 



5. SO(4) Cheshire charge 

The single half-quantum vortex line behaves like the Alice string because a quasi- 
particle changes its spin quantum number after it adiabatically moves around the 
half-quantum vortex once. For example, in the 3 He-A phase, a quasi-particle with 
spin 1 flips its spin to j up to a U(l) Berry phase. The half-quantum vortex in the 
quintet superfluid behaves as a non-Abelian generalization with the SU(2) Berry 
phase. Without loss of generality, we assume that d is parallel to 64 at the azimuthal 
angle <f> — 0. As </> changes from to 2ir, d is rotated at the angle of </>/2 in the plane 
spanned by £4 and h, where n is a unit vector perpendicular to £4, i.e., a vector 
located in the S 3 sphere spanned by ei^.3,5- We define such a rotation operator as 
U{h 1 <f)/2). When U acts on an 50(5) spinor, it takes the form of 

U(n,-) =exp{-i-— — } (19) 
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where r &4 = i[r fc ,r 4 ]/2 are 5*0(5) generators in the 4x4 spinor representation; 
when U acts on an 5*0(5) vector, it behaves as 

U(n, 0/2) = exp{-i^n b L M } (20) 

where L ab 's are the 50(5) generators in the 5x5 vector representation explicitly 
defined in Eq. 1111 The resulting configuration of d is 

d(n, 4>) = U(h, (f>/2)d{n, 0) = cos — sin —h. (21) 

As fermionic quasi-particles circumscribe around the vortex line adiabatically, at 
= 2tt fermions with S z = ±| are rotated into S z = ±5 and vice versa. For conve- 
nience, we change the basis VP for the fermion wavefunction to (||), | — |), l^), | — \)) T ■ 
After taking into account the 7r phase winding of 9, 'J' transforms by 

* a ^%=iU{n,-K) a ^p= (^X) ^ (22) 

where W is an SU(2) Berry phase depending on the direction of h on the 5 3 sphere 
as 

w(f . )= (ns+im-m-in 5 \ 
\ni — in 5 n 3 — in 2 J 

The non-conservation of spin in this adiabatic process is not surprising because the 
50(5) symmetry is completely broken in the configuration depicted in Fig.[T]B. 

A more interesting but related concept is the Cheshire charge, which means that 
a pair of the half-quantum vortex loop can carry 50(4) spin quantum numbers. 
An intersection between the half-quantum vortex loop and a perpendicular plane 
is depicted in Fig. [2l where ^2 are respect to the vortex and anti-vortex cores 
respectively. Without loss of generality, we assume d(r) — > 64 as r — * 00 where 
an 50(4) symmetry generated by T a b(a, b = 1,2,3,5) is preserved. In analogy to 
Fig. [T]B, the d vector is described by the difference between two azimuthal angles 
A(f> = 02 — 0i as 

d(n, A0) = cos ^^e 4 — sin -^n, (24) 

where n again is a unit vector on the S 3 equator. This classical configuration is 
called a phase-sharp state denoted as \n) v t- Because the above 50(4) symmetry is 
only broken within a small region around the half-quantum vortex loop, quantum 
fluctuations of h dynamically restore the 50(4) symmetry as described by the 
Hamiltonian 

M 2 

Hrot= Yl -2?» ^ab = i(n a dn b -n b dn a ), (25) 

a,6=l,2,3,5 



with the moment of inertial 



/ = w / dPr posin 2 ^. (26) 
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Thus the zero modes \n) vt are quantized into the global 50(4) Cheshire charge 
states, which are a non-Abelian generalization of the U(l) case in the 3 He-A phase 
13^1. The global Cheshire charge density is localized around the half-quantum vortex 
loop. In contrast, the Cheshire charge in gauge theories is non- localized ^1 

The 50(4) algebra can be grouped into two commutable sets of 577(2) generators 

as 

t^tD = l(±r 35 - r 12 ), t 2 (t> 2 ) = i(±r 3 i - r 25 ), 

r 3 (T 3 ') = i(±r 23 -r 15 ). (27) 

^1,2,3 and T[ 2 3 act in the subspaces spanned by |±§) and |±|), respectively. 50(4) 
representations are denoted by \T, T 3 ; T', T3), i.e., the direct-product of representa- 
tions of two SU(2) groups. The half-quantum vortex loop in the 50(4) Cheshire 
charge eigenstates is defined as 



\TT 3 ;T%) vt = [ dhF TTa . T , n {h)\n) vU (28) 
Jnes 3 

where Fxt 3 -,t't^ (fi) ar e the 5 3 sphere harmonic functions. Thus \TT^]T'T^) vt is the 
non-Abelian generalization of the usual number-sharp state in U(l) theories. 




Fig. 3. The topological generation of quantum entanglement. The initial state \i) is a product 
state of a zero charged half-quantum vortex loop and a quasiparticle with S z =3/2, both of which 
are a singlet of the SU(2) group of T' acting in the subspace spanned by | ± The final state 
I/} is an EPR state of the T' group as described by Eq. 1311 



6. Generation of entanglement 

When a particle passes the half-quantum vortex loop, Acf> changes from to 2ir. 
The conservation of the 50(4) spin is ensured by exciting the Cheshire charges 
and generating quantum entanglement between the particle and the half-quantum 
vortex loop. We demonstrate this process explicitly through a concrete example, 
with the initial state \i) made up from a zero charged half-quantum vortex loop and 
a quasiparticle with S z = | as 

\i) = / dn \n) vt ® (u c\ + v c_3_)\fl) qp , (29) 
Jnes 3 2 2 
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where is the vacuum for Bogoliubov particles. For each phase-sharp state \h) v t, 
the particle changes spin according to Eq.[22]in the final state |/). The superposition 
of the non-Abelian phase gives 

|/> = / dh {u {W\ 1C \ + W^cl 1 )+v (Wgci + VF 2 T 2 c„ i )} \h) vt (8 |n) w 

JneS 3 l 2 2 2 2 j 

dh(h 3 — ih2)\n)vt <8 (u c\ + v c_i)\Cl) qp 

n£S 3 2 2 

dh(hi — ih 5 )\h) vt ® (u c^i — v ci)|0) gP) (30) 

AeS 3 2 2 

as depicted in Fig. [3] In terms of the 5*0(4) quantum numbers, \i) is a product state 

2 2' 0Q)gpj 



of |00;00)„ t ®|±±;00) 91 ,, and |/) is 



.111-1, . 11. ,1111, , 1-1. 

I 2 r 2~ U ® |0 ° ; 2 - 1 2 2 ; 2 2 } ^ 8 |0 ° ; 2^ (31) 
In the channel of (T", T^), the final state is exactly an entangled Einstein-Podolsky- 
Rosen (EPR) pair made up from the half-quantum vortex loop and the quasi- 
particle. We note that this mechanism of generating the quantum entanglement is 
entirely topological, dependent only on whether the trajectory of the quasi-particle 
lies inside or outside of the half-quantum vortex loop. In contrast, the half-quantum 
vortex loop in 3 He-A system only exhibits the U(l) Cheshire charge, thus the final 
state is still a product state without the generation of entanglement. 

Similarly, the entanglement between a spin wave impulse and the half-quantum 
vortex loop can also be generated. We consider the four local transverse bases 
eb(b = 1,2,3,5) at Atfi — 0. Assume that the initial state made up from the half- 
quantum vortex loop and the spin wave is 

dh \h) vt ® (ei + ie 5 ) sw , (32) 

where spin wave impulse carries S z — 2. For each phase-sharp state \h) vt of the 
half-quantum vortex, the frame bases at A(j) = 2tt transform to e a — > e a — 2h(e a ■ h). 
Thus the entanglement is generated in the final state |/') as 

\f) = I dh \h) vt ® (ei -I- ie 5 ) sw 
Jhes 3 

-2 dh (m + in 5 )n b \h) vt ® i bySW . (33) 

JnGS 3 



7. Conclusion 

Recently, Bose condensation of the 174 Yb atom and sympathetic cooling between 
174 Yb and the fermionic atom of m YbS01have been achieved. Their electron config- 
urations are the same as the Ba atoms except an inside full-filled 4/ shell, thus the 
spin-3/2 systems of 135 Ba and 137 Ba can be possibly realized in the near future. At 
the present time, scattering lengths of these two Ba atoms are not available. How- 
ever, considering the rapid developments in this field, we are optimistic about the 
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realization of the quintet pairing state and the associated non-Abelian topological 
defects. 

We briefly discuss here the factors that limit the life time of the entanglement 
which come from spin decoherence. As shown above, the generation of entanglement 
only depends on whether the particle trajectory penetrates the half-quantum vortex 
loop or not, but does not on the detail of how it penetrates the vortex loop. Thus 
this process is topological and is robust. However, spin decoherence does come 
from the interaction between particles and vortex loops with the bulk low energy 
collective excitations. The quintet pairing states have gapless spin-wave excitations. 
The particle spin and the Chesire charge of the half-quantum vortex loop can flip 
when spin-waves scatter with them, which is the leading order spin decoherence 
mechanism. Nevertheless, spin-waves are Goldstone particles which only interact 
with other excitations through the derivative coupling, i.e., the coupling constant 
vanishes at long wave length limit. At low temperatures, only long wavelength spin 
waves are excited, thus their spin decoherence effect is small. 

In summary, we have studied the quintet pairing state in spin 3/2 fermionic 
systems with the 5*0(5) symmetry, including its Goldstone modes and the non- 
Abelian topological defects. The non-Abelian Berry phase effect and the Cheshire 
charge behavior are analyzed in detail. The topological mechanism of generating the 
quantum entanglement between quasi-particles and the half-quantum vortex loop 
could be useful for topological quantum computation. 
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